Papers with weight-activation quantization error
ATQ: Activation Transformation forWeight-Activation Quantization of Large Language Models (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Quantization methods are available to solve the problem of high computational and storage costs for Large language models. |
| Approach: | They propose an INT8 weight-activation quantization method that can achieve lossless accuracy. |
| Outcome: | The proposed method can achieve lossless accuracy on OPT and LLaMA families. |